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2 Chapter 2. Solving Recurrences 


This chapter is predominantly concerned with solving 
a linear recurrence with constant coefficients. 


The first approach is completely general: 


one derives a generating function for the sequence 
specified by the recurrence, and then one analyzes 
that generating function so as to derive a closed 
form for the values in the sequence. 


The second approach is restricted to linear recurrence re- 
lations with constant coefficients: 


using prior memorization or a table of standard pat- 
terns, one sees how a given linear recurrence fits 
a standard pattern and adapts the solution. 


How to solve simultaneous recurrences is described in 82.5. 
Special properties of the Fibonacci numbers are featured 
in $2.6. The focus of §2.7 and §2.8 is on techniques for 
transforming a more complicated type of recurrence into 
a linear recurrence with constant coefficients, thus precon- 
ditioning it for solution by the well-established methods of 
the earlier sections. 
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2.1 TYPES OF RECURRENCES 


REVIEW FROM 81.2: 


e A recurrence prescribes a set of initial values 
Lo = bo r1 = by ede ri = dz 
and a recursion formula 
Die SO Gite Caos ae @) 10k SK 


from which one may calculate the value of x,,, for any 
n > k, from the values of earlier entries. 


DEF: A recursion formula of the form 
Ln = An—-1%p-1 TF Gn—2%n—-2 TF +++ + Aolo + a(n) 


in which each term is linear is a linear recursion. Each 
coefficient a; may be either a constant coefficent, the 
same for all n, or a function of n, that is, a variable 
coefficient. 


e It is a recursion of degree d if the number of co- 
efficients a; that are non-zero is bounded, and if the 
smallest subscript among the non-zero coefficients is 


n—d. 
e The function a(n) is the particularity function. 


e It is a homogeneous recursion if a(n) = 0. 
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Some Linear Recursions 


Linear recursions are usually easier to solve than non- 
linear recursions. 


Example 2.1.1: The Tower of Hanoi recursion (intro- 
duced in §1.2 and solved in §2.2) 


hy = ye 41 Oat) 


is a non-homogeneous, linear recursion of degree 1, with a 
constant coefficient. 


Example 2.1.2: The Fibonacci recursion (introduced in 
80.2 and §1.2 and solved in §2.5) 


Fn = ta a Fn2 (2312) 


is a homogenous linear recursion of degree 2, with constant 
coefficients. 


Recurrences without Fixed Degree 


A recurrence of fixed degree d for a sequence (z,,) 
prescribes x, as a combination of the recent past entries 


In-1 Un-2 Pee Pap d 


In the most important kind of recurrence without fixed 
degree, the value of x, is a combination of entries whose 
indices are a fraction of n. ‘This is called a divide-and- 
conquer recurrence. 
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Example 2.1.3: The merge-sort recurrence (explained 
and solved in §2.8) 


ng. = 1s 
2Mp2, +n (2133) 


Mn 


is non-homogeneous linear recurrence, without fixed de- 

gree, with a constant coefficient. Its recursion formula 

expresses that the problem of sorting a list of length n is 
mr 


reduced to merging two lists of size 5. 


Variable Coefficients 


The three recursions (2.1.1), (2.1.2), and (2.1.3) all 
have constant coefficients. One of the most important lin- 
ear recursions with variable coefficients arises in the study 
of permutations. 


REVIEW FROM 80.5: 


e A permutation on a set S is a one-to-one, onto func- 
tion from S to itself. 


e Theorem 0.5.3. Every permutation is a composition 


of disjoint cyclic permutations. 


DEF: A derangement is a permutation 7 with no fixed 
points. That is, there is no object x such that a(x) = a. 
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Example 2.1.4: Figure 2.1.1 illustrates a derangement. 
fo 
UL 
Fig 2.1.1 The derangement (1 3) (2 5 4). 


DEF: The derangement number D,, is the number of 
derangements of the integer interval [1 : n]. 


The derangements of the smallest integer intervals [1 : 7] 
are given in ‘Table 2.1.1. We observe that a derangement 
has no 1-cycle in its disjoint cycle form. 


Table 2.1.1 Derangements of Small Intervals [1 : n]. 


(1 2) 


(123) (132) 

(1 2)(8 4) (13)(24) (1 4)(2 3) 
(1234) (1243) (1324) 
(1342) (1423) (1432) 
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Prop 2.1.1. The derangement numbers D,, satisfy the 
following recursion formula. 


Dy =i PGs (2.1.4) 


Proof: Every derangement of [1 : n] such that n does 
not lie in a 2-cycle can be formed by inserting the number 
n, immediately after one of the n — 1 numbers in some 
cycle of some derangement of [1 : n — 1]. 


Every derangement of [1 : n] in which n does lie in a 2- 
cycle can be formed from some derangement 7 of [1 : n—2] 
either by adding the 2-cycle (n—1 n), or by replacing one 
of the n — 2 numbers 7 in some cycle of 7 by the number 
n —1 and then adding the 2-cycle (j 7). & 


Example 2.1.5: The derangement recurrence (consid- 
ered in more detail in §5.4) 


Do = 1, Dy, = 0; 
Dy, = (n — 1 eve + (n— 1)Dp—2 


is homogenous, linear, of degree 2, whose coefficients are 
variable. The sequence it specifies is convex, since 


Days a Dy-1 _ (nD, + nDy_-1) ar Dy-1 


2 2 
Sep 
=H 2 
> D, forn>2 
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Even without solving the derangement recurrence, it is 
possible to prove inductively that most permutations have 
a fixed point, that is, that the ratio a of derangements 
to permutations is less than half. 


BASIS: This is clearly true for n = 1 and n = 2. 


IND STEP: For n > 3, we have 


Dy, = (n — 1)Dp-1 ++ (n = 1)Dp—2 


< (nO y (ny 7! Gina nyp) 
= uae = ma 5 cae 

n! 
SD 


Some Non-linear Recurrences 


All of the recursions (2.1.1), ..., (2.1.4) are linear. 
Various other important recurrences are non-linear. 


Example 2.1.6: The Catalan recurrence (introduced in 
§1.2 and solved in §4.4) 


Cy eS Ae 


Ch = COCA =P CL Ca oe * eg CH 


is a homogenous non-linear recurrence without finite de- 
gree, with constant coefficients. 
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2.2 FINDING AN OGF 


This section is devoted to the fundamental method 
for solving a recurrence of the form 


06. => 06s. age = Oe initial conditions 


Gi = (Gn 35008590) tor Sk recursion 


It uses three steps to determine a closed form for the 
corresponding generating function 


G2) = ya (22:15 


and then a fourth step to derive a closed formula for the 
coefficients g,.. We describe the four steps of this funda- 
mental method with reference to this running example 
of a recurrence system. 


Example 2.2.1: ‘This is a linear homogenous recursion 
of degree 2 with constant coefficients. 


O47. = 56,-4-— Ogn=> Torn. > 1 


Step la. Multiply both sides of the recursion equation 
by. 2's 


Gn% = 5gn-12" — 6Gn—22" 
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Step 1b. Sum both sides of the resulting equation over 
the same range of values, with a lower bound as low as 
possible, and upward to oo. 


(1b) ye Gae = boiz — S| 69n—22” 
n=2 n=2 n=? 


We start all the sums at the lower bound n = 2, because 
starting any lower would take the subscript of g, below 
0 on the left side, and this recurrence system does not 
specify either g_2 or g_1. 


Step 2. Recalling equation (2.2.1), we observe that 
OO OO 
So m2” = Yo gn2z” — nz - 9 = Gz) — nz - 9 


Thus, we can replace each infinite sum in equation 
(1b) by an algebraic expression involving the generating 
function G'(z). 


(2a) Soe = 52 oie 2162" DL gases 
n=2 n=2 n=2 

(2b) G(z) — g1z — go = 5z(G(z)— go) — 6z7G(z) 

In (2a), we factor the terms of each sum on the right, so 


that the power of z in the summand equals the subscript. 
In (2b), we replace all three infinite sums. 
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Step 3. Solve for G(z). 


(3a) G(z) (1 —5z +627) gz + go — 5902 


= 2z+1-—52z 

1—3z 
3b G ae ge 
(36) Ve) =r eee gee 


In (3a) we collect the G(z) terms on the left and substi- 
tute initial values for the low-subscripted entries of the 
sequence. In (3b), we isolate the generating function G(z) 
on the left. 


Step 4. Solve for gn. 


1 —3z 1 
ee “Gon eee Tom 
(4b) = State" 2 Gy 


Step (4a) converts the result of step (36) into a more 
tractable form. In (4b) we extract the coefficient gn. 


Check the Answer: A better way to confirm the answer 
than by retracing the steps is to verify that the answer 
Gn = 2” satisfies the recurrence. 


Gg. = 2 S141, a. = 2> So initial conditions 
gn = 99n-1 — 99Gn-2 recursion 

= 5-27-* — 6-2" 

= 00 aos o8e 

= 9,97-1 

= 2” 
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Step (4a) is usually not quite this simple, as illustrated by 
this variation on the running example. 


Example 2.2.1, cont.: Suppose that the initial values 
in the preceding problem were changed to 


go = 99 = 2 


Then steps 1 and 2 would be as before. However, here is 
how we would finish in the modified problem. 


Step 3. Solve for G(z). 


(3a)  G(z)\(1—5z24+ 627) = giz + go — 5299 


= 2z7 +0-0 

22 
b a ee ae 
(38) Gz) (Shep 


Step (3a) collects the G(z) terms on the left and substi- 
tutes initial values for the low-subscripted entries of the 
sequence. Step (30) isolates the generating function G(z) 
on the left. 


Step 4. Solve for g,. Step (4a) anticipates a method 
called partial fraction decomposition, which is described 
in the next section. For now, we can confirm that the cal- 
culation in Step (4a) is correct, by proceeding from right 
to left on its top line. The next section describes how to 
do such a calculation from left to right. 

2g —2 2 


(4a) G(z) = G@=3)0=3) 1=0n” Tas 
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= e (—2)2"2" + s 2g Ze 
n=0 


n=O 


(4b) > gp = —2°t1 + 2.3" 


Check the Answer: As before, we verify that the answer 
satisfies the recurrence. This time the answer is 


GS 8 


GS A BO SS a a =. initial conditions 
gm = -2742-3' = -44+6 = 
Gn = 99n-1 — 99n-2 recursion 


5 (—2% + 2-3" 1) — 6(-27-1 4.2.3") 
(—5)-2” + 10-3"? + 3.2” — 4.3"71 
—2-2" + 6-3" 

= yh a. 30 


Example 2.2.2: The method of generating functions 
also solves non-homogeneous recurrences. We illustrate 
this with a revisit to the Hanoi recurrence. 


Ag. =" 0; hy, = 2hyn-1 +1 forn>0 
We proceed through the same four steps. 


(1a) he = Die ee 


(1b) Shine” Sina 2" a Soe" 
n=1 n=1 


n=1 = 
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(2a) Shine” = 22S hina" i So zt} 
(26) H(z) — ho = 22H (z) + — 

(3a) HA(z)(l—-2z) = ho + esi — 
(36) He) = ayaa 


We explain in §2.3 how to split a rational function. 








1 1 
4a) H(z) = = 
a) TN) isOer eae 
(4b) = ee ee a al 


This solution was suggested in $1.2 by examination of 
small cases and then confirmed by mathematical induc- 
tion. 
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2.3 PARTIAL FRACTIONS 


Suppose that a linear recurrence 
Ln = Gn—-1%n-1 + Gn—2En-2 +°** + aAQXo + a(n) 


has constant coefficients a; and that its particularity func- 
tion a(n) is a polynomial in n. Then the generating func- 
tion constructed by Steps 1, 2, and 3 of the method of §2.2 
is a proper rational function. 


by t biz t-+++ bs 
Co tee tee + cz" 


Ge). = oe = 
n=0 


Step 4 is to complete the solution, by deriving a closed 
formula for g,. ‘This section develops the details of Step 4. 
Like the previous section, this section explains the details 
of the method with the aid of a running example. 
Example 2.3.1: ‘The running example now is the ratio- 
nal function 
1 —95z 
G SS 
Oe 62 1 


One may verify that it corresponds to the recurrence 


go=1 "7 = 2, g = —2; 
In Tgn—-1 — 16gn—2 + 12gn-3 forn> 2 
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Step 4a-1. Factor the denominator into linear factors. 
Cot eaz tee tee = ep(1—712z)% +++ (1 —Tpz) 


with ¢; +---+e, =t. For simplicity, we take cp = 1. For 
our example, we have 


1—5z 
1—7z+16z2 —12z3 
_ 1 —5z 
(1 —2z)2(1 — 32) 


G(z) = 


By what is called the Fundamental Theorem of Algebra, 
a polynomial with complex coefficients has a factorization 
into powers of linear polynomials. 


Remark: There is no general method for calculating the 
roots of a polynomial exactly for higher degree polynomi- 
als. Nonetheless, in practice, one commonly encounters 
polynomials that can be factored by elementary methods. 


Step 4a-2. Analyze the rational function into a sum of 
k rational functions, each of whose denominators is one of 
the factors (1—7;)*/, and whose numerators are “unknown 
polynomials”, each of the respective form 


byose Caen aie 
Thus, 
1—6z b19 + 6112 bo. 


1—7z+1622—-1228 (1-2z)? 9 (1-32) 
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Step 4a-3. Recombine these summands, with a single 
denominator. For the present example, 


1—5z = (b1.0 + biiz)(1 = 3z) + by o(1 = 22\° 


1—7z+1622—1223 © (1 — 2z)2(1 — 3z) 


Step 4a-4. Then collect terms according to the exponent 
of the factor z‘. For the present example, 


(61,9 + 62,9) + (—3b1,0 + 61,1 — 462.9) + (—3b1,1 + 4b2,0)2? 
1—7z+162? — 1223 


Step 4a-5. Next obtain a system of ¢ linear equations in 
t unknowns 6; by equating each resulting coefficient of 
z* in the numerator to the corresponding coefficient of z‘ 
in the numerator of the original linear function, and solve 
that system. 


b1.0 + bo5 = 1 bio = 7 
—301 9 + 01,1 — 4629 = —-9 > => O11 = —8 
—3b1 1 + 4b2,0 = 10 b2.0 = 6 


Step 4a-6. Now substitute these solutions into the right 
side of the equation of Step 4a-2. 


1—5z 7—8z —6 


1—7z+16z22-12z3 (1-22)? 1-32 


Step 4a-7. ‘Transform each term on the right into the 
product of its numerator with the power series correspond- 
ing, via Corollary 1.7.5, to its denominator. ‘Then simplify 


18 Chapter 2 Solving Recurrences 


each power series. 


(7 — 82) SS Ce 2r2" 4+ (—6) ys ) gt 2n 


= (7-82) 5) (n+1)2"2"-6 5 3"2" 


Step 4a-8. Finish by combining into a single power series, 
and then extracting a closed formula for g,,. 


= 5 [(8n+7)-2"-6-3"] = gn = (3n+7)-2" —63" 
n=0 
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2.4 CHARACTERISTIC ROOTS 


The method of characteristic roots assumes that 
a homogenous linear recurrence of fixed degree d with con- 
stant coefficients has solutions of the form 


Example 2.4.1: Running example for this section. 


Gn = 99n—-1 — 6Gn—-2 forn>1 


Characteristic Equation 


Step 1. Form the characteristic equation, as follows. 


(la) Substitute 7” for g, in the recurrence. 
gS oF or 
(1b) Factor out 7”, 
To = br 6 
(1c) Move the non-zero terms to the left of the equals sign 
rT? —5r +6 = 0 


thereby forming the characteristic polynomial. 
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Step 2. Factor the characteristic polynomial. 
(7 —2)(7 —3) = 0 


We call the roots of the characteristic polynomial 
tt = 2. and: a =] 3 


characteristic roots. They correspond to the linear fac- 
tors of the denominator of the generating function derived 
in Step 4 of Example 2.2.1. We observe that 


9 =F = 2" and. g@,. => 7% = 3" 


are solutions to the given recurrence. 


Step 3. As a general solution to the given homogeneous 
recurrence, form a linear combination of the characteristic 
roots, using unknown coefficients. If none of the roots is 
repeated, the result of this step is as follows. 


Gn = 62" + 623" 
We shall eventually return to this step to elaborate on the 
case in which one or more roots is repeated. 


Step 4a. Use the initial conditions to write a system of 
linear equations for the unknown coefficients. 


go = 1 = 612° + 93° = by + by 
Cg=]2 = bi 2? ++ es = 2b, + 3b 
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Step 4b. Solve for the unknown coefficients. 


bj. = b, = 0 


Step 4c. Substitute the solutions from Step 4b into the 
general solution of Step 3. 


Gi 2 


We observe that this is the same solution previously ob- 
tained for this recurrence in Example 2.2.1. 


Alternative Initial Values 


Suppose that we now consider, as in the continuation 
of Example 2.2.1, the alternative initial values 


Then the finish would be as follows. 


Step 4a. Use the initial conditions to write a system of 
linear equation for the unknown coefficients. 


go = b)2° + 693° = 6 + by 
a bi: ++ b53+ 26, + 3be 


Step 4b. Solve for the unknown coefficients. 


b, = -2 by = 2 
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Step 4c. Substitute the solutions from Step 4b into the 
general solution of Step 3. 


GS SI 


This is the same solution obtained previously, in Example 
2.2.1, with these alternative initial values. 


Repeated Roots 


We now apply the method of characteristic roots to 
the recurrence of Example 2.3.1. 


9 = 1, m = 2, go = —2; 
On = T9n-1 — 16gn—2 + 129gn_3 forn > 2 


Step 1. The characteristic equation is 
tT? — 77? + 167 — 12 = 0 
Step 2. Factor the characteristic polynomial. 
a2)" =3) = 0 
Step 3. Ifa root 7; has multiplicity ¢;, then use 
Of a a ee, a Oe at tee 


in forming the general solution with unknown coefficients. 
In the present example, the general solution is 


Section 2.4 Characteristic Roots 23 


Gn = bie. ++ by 4n2" + bo3” 


Step 4a. Use the initial conditions to write a system of 
linear equation for the unknown coefficients. 


go = 1 = by 92° + b110-2° + b23° = bio + be 
9, = 2 = by o2" + by11-2* + 623° = 26,9 +2611 + 3be 
gz = —2 = 1927 + b112-27 + b937 = 461.9 + 8b11 + be 


Step 4b. Solve for the unknown coefficients. 
61.0 = 611 ae by = —6 


Step 4c. Substitute the solutions from Step 4b into the 
general solution of Step 3. 

Gn = T-2" + 38n-2” — 6-3” 
This is the same solution obtained in Example 2.3.1. 
Remark: The proof that this method works is a matter 


of checking that it always yields the same solution as the 
method of generating functions. 


Non-homogeneous Equations 


To extend the method of characteristic roots to a non- 
homogeneous linear recurrence of degree d with constant 
coefficients 


Go = 00, «++, Ga-1 = ba-13 
Gn = An—-19n—-1 + +++ + Gn-aGn—a + a(n) 
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we first isolate the associated homogeneous recur- 
rence 


In = An-1 Gn-1 at eee, Sd Gn—d 
obtained by dropping the particularity function. 


We illustrate the rest of the extended method with a revisit 
to the Hanoi recurrence. 


ho = 0; 
hyn = 2hyn-1 +1 forn>0 


Use Steps 1, 2, and 3 to find a general solution to the 
homogeneous recurrence h, — 2hy,_, = 0. 


Steps 1, 2. 7-2 = 0 


Step 3. ee 


The result so far is called the homogeneous part of the 
general solution. 


Step 3N. Find a trial function h,», that satisfies the orig- 
inal recurrence. It is called the particular solution or 
the particular part. It usually resembles the particular- 
ity function. For instance, if the particularity function is 
a polynomial in n, then the trial function can be a polyno- 
mial of the same degree, with unknown coefficient. Since 
the particularity function for the Hanoi recurrence is a 
constant, the trial function can be a constant. 


ae 
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Substitution into the original recurrence leads to a system 
of linear equations in the unknown coefficients. 


h, = 2hn-1+1 (recurrence) 
ec = 2c+1 (after substitution) 
eS a1 (particular solution) 


h, = hy th, = 0-2-1 (general solution) 


Step 4a. Use the initial conditions to write a system of 
linear equations for the unknown coefficients. 


Ligne On ce UP a, eS il 


Step 4b. Solve for the unknown coefficients. 


al 


Step 4c. Substitute the solutions for 6; and bz from Step 
Ab into the general solution of Step 3. 
Ry S27 = 1 


This is the same solution obtained in Example 2.2.2 by 
the method of generating functions. 


Example 2.4.2: We modify Example 2.4.1 by giving the 
recurrence a polynomial particularity function 


go = i nan = 2; 
Qn = 99n—-1 — 69n—2 + 4n —3 forn>1 
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We have previously derived for the homogeneous recur- 
rence the general solution 
In = 6,2” + by 3" 
Step 3N. As a particular solution we use the form 
In = C1N + Co 
and substitute it into the particularized recurrence. 


4n—-3 = gn — 5Gn—1 + 69Gn—-2 (recurrence) 
(cin +c¢o) — 5(e1(n — 1) + e9) + 6(e1(n — 2) + co) 
n(cy — 5c, + 6c,) + (ceo — 5c, + 5e9 — 121 + 6c) 
= 2nc, + 2co — Ter (after substituting) 


This leads to the linear equations and solutions 


a 2C}1 11 
cy = Z co = = 
—3 = 2C0 = TC4 


which are combined with the general solution to the ho- 
mogeneous part. 


- 11 
Jn = Jn + 9n = bya" + O23" + an + > 
Step 4a. Use the initial conditions to write a system of 
linear equations for the unknowns 6, and bo. 


11 
bi? ahs 3 ee = 


90 = 1 


11 
nN =2= by 2! + be3! + 2-1 + > 


Section 2.4 Characteristic Roots 2/ 


Step 4b. Solve for the unknowns 6; and be. 


-5 = by ale bo by = —8 
7 

11 = 
>) = 261 ++ 365 by _ 9 


Step 4c. Substitute the solutions for 6; and bz from Step 
Ab into the general solution from Step 3N. 


gor fF gm  oy  U 
n = —3: re n — 
J 9 9 


Example 2.4.3: We now modify Example 2.4.1 by giv- 
ing the recurrence an exponential particularity function. 
g=1, Hm = 2; 
In = 59n—1 — 6Gn—-2 + (-1)" forn>1 


We have previously derived for the homogeneous recur- 
rence, as in Example 2.4.2, the general solution 


Gn = 612" + 623” 
Step 3N. As a particular solution we use the form 
In = ce(—1)” 
and substitute it into the particularized recurrence. 
(—1)" = Gn — 59n-1 + 69n-2 (recurrence) 
c(—1)” + 5c(—1)” 4+ 6e(-1)” 


= 12c(-1)” (after substituting) 


1 
c= — (solution) 
2 
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Combine this solution with the general solution to the 
homogeneous part. 


A . n n 1 n 
Gn = Gn + Gn = b,2 + 693 ar ao) 


Step 4a. Use the initial conditions to write a system of 
linear equations for the unknowns 6, and bo. 


1 
bio? ae hs3? a 


— an (ae 
go 12 
1 
at Os iD a eo 3 
J 14. + 02 DD 


Step 4b. Solve for the unknowns 6; and bo. 


11 8 
Jt 2h b a 
1D 1+ 09 1 12 
25 3 
— ==; Dh b b = — 
1D 1 + 3be 2 1D 


Step 4c. Substitute the solutions for b; and bz from Step 
Ab into the general solution from Step 3N. 


8 3 1 
J Doe Pp Pa 


Complex Roots 


A recurrence in which the initial values are real and 
the recursion has real coefficients has a characteristic poly- 
nomial with real coefficients. The roots of such a polyno- 
mial may be complex. 
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Example 2.4.4: ‘The recurrence 


gm =1,m = 2; 
Gn = 29n-1 — 2gn—2 forn>1 


has the characteristic equation 
7 —-I%+2=0 
with roots 
™T = 14+7 and ~% = 1-1 
Thus, the general solution is 
Gn = b,(1 +4)” + be(1 —1)” 
The init conds yield the complex simultaneous equations 


go = eS by(1+4)° + be(1 —1)° = bi + bo 
gq = 2S b,(1 +i)" ++ b(1 —1)' 


with solution 


taped ees 


bh = 
: i i 








Hence, the general solution is 


1 
—(1 _ pews 


1 
—— 1tajyrti _ 
g (1 +7) % 


2i 
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2.5 SIMULTANEOUS RECURSIONS 


With simultaneous recurrences, one uses a substitu- 
tion from one recursion to reduce the number of different 
sequences occurring in other recursions. The objective is 
to reduce the solution of the initial system to the solution 
of one or more independent linear recurrences. 


es 
= oe 


Fig 2.5.1. Fibonacci rabbit 2) XD = 
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Fibonacci Rabbits 


In 1202, Fibonacci imagined a kind of rabbit that 
takes one month from birth to mature, with a gestation 
period of one month. Every mature female gives birth each 
month to a litter of two, with one male and one female. Let 
b,, represent the number of pairs of newborn rabbits, and 
let a, be the number of pairs of adult (mature) rabbits. 
Suppose that there are no rabbits at n = 0 months, and 
that a newborn pair initiates the system after 1 month. 


The total number f,, = a, +6, pairs of rabbits is modeled 
by a simultaneous recursion with initial conditions 


ao = JO, a, = QO, by = 0, bp = 


and the relational equations 


An = An—-1 + On —1 
Dn = O&n-1 
In = Gn + Op 


A first step in solving is to use substitutions to reduce it 
to a recurrence with a single unknown. We see that 


Gn = Qn—-1 + On-1 = fn-1 (2.5.1) 
yy. = Gat: Sa (252) 
Fn = An + Dn, = pl ale In-2 (2.5.3) 


and that fo = a9 +69 =0 and fi =a, +6; =0+1=1. 
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The resulting single-variable recurrence 


fo = 9, fi = 1 
Fn fa ar In-2 


is recognizable as the Fibonacci recurrence. 


Ubiquitousness of the Fibonacci Seq 


Although Fibonacci’s rabbit model is Fibonacci’s in- 
vention, the sequence it yields is evidently nature’s inven- 
tion. For instance, what follows immediately is an expla- 
nation of an occurrence of the Fibonacci sequence in the 
construction of a nautilus shell. 


DEF: A Fibonacci rectangle is any rectangle, subdivided 
into squares whose sides are of lengths that are Fibonacci 
numbers, in the following sequence: 


e The Fibonacci rectangle r; is a 1 x 1 square. 


e For each n > 2, the Fibonacci rectangle r, is con- 
structed by placing a square along the longer side of 
the rectangle r,_1, as in Figure 2.5.2. 








2 2 
3 
ee 


Fig 2.5.2 Fibonacci rectangles. 
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DEF: A spiraled Fibonacci rectangle is a Fibonacci 
rectangle in which each square of size 5 x 5 and larger is 
placed so that it touches three previous squares, rather 
than two. Figure 2.5.3 illustrates a spiraled Fibonacci 
rectangle. 





Fig 2.5.3. Fibonacci spiral. 


We observe that the inscribed spiral in Figure 2.5.3 has the 
shape of a nautilus shell. It is called a Fibonacci spiral. 


Solving the Fibonacci Recurrence 


We now use the method of generating functions to 
solve the Fibonacci recurrence. 
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Step ls 7.20 = neiz nee 
OO OO OO 
he = facie as foe 
n=2 n=2 n=2 
Step 2. Use F(z) as the generating function for f),. 
OO OO OO 
ye = ojos aa Ze eee 
n=2 n=2 n=2 


Fay fee fo = 2b of) Ee) 


Step 3. Solve for F(z). 


F(z\(l—z—27) = fiz + fo — foz = 1z +0-02 = z 


z 
Be ee) 


Step 4. To solve for f,, we use the quadratic equation 


Lage = (1-246.) (115%) 
2 Z 


whose roots involve the golden mean and its conjugate 


1+ v5 és VS 
a 5 and Yy = 5 














respectively. We then use partial fractions 








Z i 1 1 
F S58 So _ 
(2) Ae = 2 V5 (— =] 
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from which we conclude 
mA) (2.5.4) 


which is called the Binet formula for the Fibonacci num- 
bers, after Jacquet Binet, who rediscovered it in 18438, af- 
ter Euler had published it in 1765. Closed forms for a, 
and b,, are readily derivable from (2.5.1) and (2.5.2), re- 
spectively. 


Proposition 2.5.1. The Fibonacci number fy, is asymp- 
totic to a, 
V5 
Proof: Since ¥ < 1, it follows that 7” is asymptotic to 
0. Accordingly, using Eq. (2.5.4) above, 
im = SE ae 
noo yt [/5 MOO yt [/5 
limi+t = 1 . 
oi 


TU CO 
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Some Tiling Problems 


One of the many other contexts in which Fibonacci 
numbers arise is tiling problems. We visualize paving a 
1 x n chessboard with tiles of various lengths. A 1 x d tile 
is called a d-tile. 


Example 2.5.1: Let t, be the number of ways to cover 
al xn chessboard with 1-tiles and 2-tiles. We have to = 
1, which represents covering a degenerate board with the 
empty arrangement. Figure 2.5.4 shows the possibilities 
forn=0,...,4. 

fy) =1 | 

t=1 [| 

6-2 TOC 

6-3 COCO 

ee OC 


Fig 2.5.4 Tiling a 1 x n chessboard. 


The number of 1 x n tilings in which the rightmost tile 
is a 1-tile is t,_1. ‘The number of 1 x n tilings in which 
the rightmost tile is a 2-tile is t,_2. The solution to the 
resulting recurrence 


fd@?=1, =); 
tn tn—1 + tn—2 


is clearly tn = fn41, the n+ 1** Fibonacci number. 
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Example 2.5.2: Observe that any tiling in which all 
the tiles are of odd length can be converted to a tiling 
with 1-tiles and 2-tiles, whose initial tile is a 1-tile, by 
breaking a tile of length 2n + 1 into a 1-tile, followed by 
n 2-tiles. This breakage operation can be inverted, since 
each maximal string of 2-tiles and the 1-tile that precedes 
it can be assembled into an odd-length tile. It follows 
that there is a one-to-one, onto correspondence between 
the two kinds of tiling. Since the number of tilings of 
al xn chessboard with 1-tiles and 2-tiles, and with an 
initial 1-tile, is the Fibonacci number t,_, = fn—2, this 
must also be the number of tilings with tiles of odd length. 
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2.6 FIBO NUMBER IDENTITIES 


In the first few entries of the Fibonacci sequence 


nm | O-1 28° 4D 6 1 -8 oe AD Al -12 
fn| 9 1 1 2 3 5 8 138 21 34 55 89 144 


for each instance of a number n and a multiple mn, the 
Fibonacci number fi, is a multiple of f,. For instance, 


i. =). 2nd 776 = 55 = 11 fF. 


This section verifies this and other visible patterns. 


Forward-Shift and Subscript Multipliers 


As a preliminary, we consider a relationship between 
fran and f,. Proceeding from k = 2, 


Fn42 = nti + fn 


frts = Free + fot = (Pnrti t+ fr) + frst 
= 2fn4i t+ fn 

fata = Pros + fate = (2frti + fr) + Pati t+ fr) 
= 3fn41 + 2fn 

forts = Fnta t+ frts = (3fnti + 2fn + (2fnrti + fn) 
= 5fnti + 3fn 


Fai a Tad ae Fn+4 = fn a 3fn) ae (Shn44 ae Din) 
= 8fn4i + 5fn 
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we observe that the coefficients of fn41 and f, are them- 
selves Fibonacci numbers. The observable pattern is con- 


firmed by the following theorem. 


Thm 2.6.1 [Forward-Shift Identity]. The Fibonacci 
numbers satisfy the equation 


In+k = Tiel ea tee for allk > 1 


Proof: By induction on k. 


BASIS: If k =1, then f; = 1 and fo = 0, and, thus, 


feinti + fe-fn = 1+fnti + O-fn = frst 


IND HYP: Assume for all 7 in the interval 0 < 7 < k that 
Fnag = Fitna + fy-1In 
IND STEP: ‘Then 


fk = date + fae (Fibonacci recursion) 
(fr-1fnti + fre-2fn) + (fe-ofnti + fr—3fn) (ind hyp) 
= (fei t+ fr—2)fnta + (fe—-2 + fe—-3) Fn (regrouping) 
IRIs. Pe (Fibonacci recursion) > 


We now confirm the initial observation regarding multi- 
ples. 
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Cor 2.6.2. For all k > 0, the Fibonacci number frp is a 
multiple of the Fibonacci number f,,. 
Proof: By induction on the multiplier k. 
BASIS: ‘This is trivial for k = 0 and k = 1. That is, 

Ton = 0 = Ofn 

fin = tn a fn 
IND HYP: Assume that the Fibonacci fj, is a multiple of 
the Fibonacci number f,,, for all 7 such that 0 <7 < k. 
IND STEP: ‘Then 
Ten = Pe Agaa 

— F(k—1)n Fr+t IE F(k-1)n-1 Fr (by Thm 2.6.1) 


By the inductive hypothesis, there is a number M such 
that f(x-1)yn = M fn. Thus, 


tien = Fg go eee a TE eats 
= (Mfrs + fe-1t)n—1) fr & 


Cassini’s Identity 


In returning to the early entries of the Fibonacci se- 
quence 


nm! O1l2 3 4 5 6 7 8 9 10 11 12 
fn} 9 1 1 2 3 5 8 13 21 34 55 89 144 
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we also observe that the square of each Fibonacci number 
differs by 1 from the product of the Fibonacci number that 
follows it and the Fibonacci number that precedes it. For 
instance, 


ffs = 5-2 = 3-341 fafa +1 
fefa = 8-3 = 5-5-1 = fsfs—1 


Theorem 2.6.3 [Cassini’s Identity]. In the Fibonacci 
sequence (f;,), 


Fntitn—1 = fe = (—1)” forn > 1 


Proof: By induction on n. 


BASIS: Confirmation that the identity holds for n = 1 is 
as follows. 


fofo = 1:0 = 0 
fP+(-l)' = 1-1-1 =0 
IND HYP: Assume that 
(papa =f” = toriakon 

IND STEP: ‘Then 
frtifn—-1 = (fa + fro—1) fn—1 (Fibonacci recurrence) 

== Tea alg es 

= oops or In fn—2 — a=: (ind hyp) 


= Tol ek + fn—2) a (—1)” 
= 7 2a (Fibonacci recurrence) <> 
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Fibonacci Number System 


It is clear that every non-negative integer is the sum 
of some Fibonacci numbers, since 1 is a Fibonacci num- 
ber. The following example adds as requirements non- 
repetition and non-consecutiveness. 


Example 2.6.1: Each of the smallest integers that is 
not a Fibonacci number is the sum of two or more non- 
consecutive Fibonacci numbers. 


4=3+1 10 = 8+2 
6=5+1 ll = 8+3 
f=] 0-2 12 = 8+3+1 
9 = 8+1 14 = 13+1 


Moreover, this property holds for some larger examples. 


100 = 89+8+3 200 = 144+4+55+1 


Theorem 2.6.4. Every non-negative integer n is the sum 
of distinct non-consecutive Fibonacci numbers. 

Proof: By induction on n. 

BASIS: ‘The number n = 0 is the sum of the empty set. 
IND HYP: Assume for some n > 0 that every number 


less than n is representable as the sum of distinct non- 
consecutive Fibonacci numbers. 


IND STEP: Let f,, be the largest Fibonacci number less 
than or equal to n. Since fm+41 > n, it follows from the 
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Fibonacci recursion that 


aed > n— fim 


Thus, when the induction hypothesis is applied to n— fim, 
the summands are non-consecutive Fibonacci numbers, 
each less than f,,-1. Accordingly, when f,, is included 
in the set of summands, the members of the resulting set 
of Fibonacci numbers remain non-consecutive, and their 
sum is 7. » 


DEF: The Fibonacci representation of an integer is its 
expression as a sum of distinct non-consecutive Fibonacci 
numbers. 


44 Chapter 2 Solving Recurrences 





2.4 NON-CONSTANT COEFFICIENTS 


A good method for solving any recurrence that is not 
specified as a linear recurrence of fixed degree with con- 
stant coefficients is to transform it into such a recurrence. 
We will apply this strategy to the quicksort recurrence. 


A Reduction Strategy 


Consider this general linear recursion of degree d with 
variable coefficients. 


f(n) ap = Cy-1 j(a= Lt ee 
+ tna f(n—d)tn—a + p(n) (2.7.1) 


Substituting f(n)¢p = Yn yields the recursion 


Yn = Cn—1Yn—1 + +++ Cn—aYn—a + p(n) (2:7.2) 


which is linear with constant coefficients, and, therefore, 
is amenable to previously developed methods of solution. 
A solution 

Yn = J (7) 
for the recursion (2.7.2) could be reverse-transformed into 
a solution 


tn = g(n)/f(n) 


for the recursion (2.7.1). 


Section 2.7 Non-Constant Coefficients 45 


Example 2.7.1: Consider the recurrence 
LQ = 0; 
2(n — 1 1 
n n 
Multiplying the recursion by n yields the recursion 
NEpn, = W2n—-—1)ep-1+1 
in the form of recurrence (2.7.1). The substitution 
NIn = Un 
yields this new recurrence in the form of recurrence (2.7.2). 
yo = 9; 
Yn = 2Yn-1 + | 


This transformed recurrence is easily solved by the method 
of generating functions or by the method of characteristic 
roots. Indeed, if we recognize it as the Hanoi recurrence, 
we already have this solution for y,: 


i a2 = 
To obtain the solution for z,,, we substitute y,/n = pn: 


Ne, S21 
2” —1 
n 





= ig = 
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Example 2.7.2: ‘To solve the recurrence 


to = 0; 
1 n—1 te 
NXn = | 1l-—— Ln—1 + (2n) forn >1 
n 
we first multiply the recursion by n”—!, thereby obtaining 
na, = (n-1)"'2,_1 +n™ 1 (2n)'™ 
= eo. SS ee or 


Substituting n"x, = Yn yields the recurrence 
yo = 0; 
1 n—1 
Yn = Yn-1 + (5) forn>1 


This transformed recurrence is easily solved. 








= 1+ : =F : + a : 
a 2° 4 gn=1 
1 
ie on—1 
By reverse-substituting y, = n”2n, we solve the given 


recurrence. 


1 9 1 2” —]1 
In = —— —_—- ——— ae 
mr Qn-1 mrgn-1 
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Sum in a Recurrence: Quicksort 


Beyond the complication of variable coefficients, the 
gquicksort recurrence has no fixed degree. It involves 
a long sum of earlier values in the sequence. Another 
preliminary to applying the methods of the earlier part of 
this chapter is to transform it into a recurrence of fixed 
degree. 


One signature step of quicksort is choosing a pivot 
entry. The other signature step is to tripartition the 
given sequence: 


e ‘The front part contains every element that is less than 
the pivot. ‘This part may be empty. 


e ‘The pivot part contains only the pivot entry itself. 


e The back part contains every entry not in the other 
two parts, all the entries that are greater than the 
pivot, plus any duplicates of the pivot. The back 
part may be empty. 


If the length of a sequence is 0 or 1, then the sequence is 
deemed to be sorted. Otherwise, it is tripartitioned, and 
then its front part and its back part are quicksorted. In the 
implementation represented by the following algorithm, 
the pivot is selected at random. (This tends to produce 
pivots whose value is relatively near to the median of the 
sequence, a fortuitous event that reduces the number of 
subsequent iterations.) The following algorithm specifies 
the details of a quicksort. 
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Algorithm 2.7.1: Quicksort 


Input: seq X = (x,;); range limits lo, hi 
Output: that same sequence in non-decreasing order 


if lo > ht then return 


else pivot := random({lo,..., hi}) 
“tripartition” (2jo,...,¢ni) into (Lpivot) plus 

PRON S45: |< tat 

back (as (9p pivot ) |e = Wrye?) 
X := concatenate(Qsort( front), Zpivot, Qsort(back)) 





Example 2.7.3: Suppose that the given sequence 
(78 49 05 14 10 90 44 39 19 55) 


gets initial pivot 39. ‘Then the first tripartition is 
front part pivot back part 


SSS. LN aan aa 
(05 14 10 19) (39), (78 49 90 44 55) 
Subscript gq denotes a part that is fully quicksorted. Sup- 
pose that at the second stage the pivots chosen in the parts 
not yet fully quicksorted are 10 and 78. Then the result 

of the second-stage tripartitioning is 


((05), (10), (14 19)) (39), 
((49 44 55) (78), (90),) 


Suppose that at the third stage the pivots chosen in the 
parts not yet fully quicksorted are 19 and 49. Then the 
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result of the third-stage tripartitioning is 


( (05 ))) (39) 
((( 78) (90)) 


at which point all parts are fully quicksorted. Concatena- 
tion proceeds level by level to this final result. 


44) (49) (55)) 


(05 10 14 19 39 44 49 55 78 90) 


Analysis of the Time to Quicksort 


Let Q,, represent the time needed to quicksort a sequence 
of length n. ‘This involves the following time expenditures: 


1 to select a pivot location 
n to tripartition a seq of length n 
Q, to quicksort a front part of length k 
Qn—k—1 to quicksort the back part of length n —k—1 


The probability that there are exactly k items smaller than 
random pivot is 


pr(k items < pivot) = — 
n 


This leads to the following recurrence. 


Qo = 0 
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n—-Ll 


O. Sage oe pr (k items < pivot) -[Qz + Qn—r-1| 
k=0 


n—1 
k=0 


n—-Ll 


2 
1 — 
veh eae 


An obstacle to solving the recurrence is the unlimited 
number of terms in the sum. Often, such a recursion can 
be transformed into a recursion of fixed degree, by setting 
up a subtraction of sums. 


n—1 
nQn = ntn* + 25° Qk (2.7.3) 
k=0 
m—2 
(n-1Qn-1 = (n-1)+(n-1)? +25— Qe 
k=0 
nm—2 
= Wr—nt+25 > Qp (QUA) 
k=0 


Productively, subtracting (2.7.4) from (2.7.3) yields 
2Qn — (M-1)Qn-1 = 2m + 2Qn-1 
and, thus, 

NQn = (n+1)Qn-1 + 2n 


which may be rewritten in the form 
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Qn ae. Qn-1 aie 2 














n+l n n+l 
After making the substitution 
Qn 
n+l . 
there is the following transformed recurrence 
Po = 0; 
Pp S228, ++ e f eal 
i n—1 n+l orn = 
whose solution is 
n 9 n i n+1 { 
Le = ——_ = 2 ——_— = 2 —- = 2(Apnii—-1 
a k+1 me k+l 2 j 7) 


which is then reverse transformed. 


Qn = (nt1)Pa = 2(n+1)(Hn4i 1) 


2(n +1) (4 - —) — 2(n+1) 


2(n+1)H, + 2 —-— 2(n4+1) = 2(n+1)H, — 2n 
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Confirming Small Cases 


Direct application of the recurrence 
Qo = 9; 
9 n—1 
C= il a 
Q er d Qk 


yields the small values 


Q = 141+ 2 [Qo] =2+0=2 
Qz = 1424 2[Q0+@] = 341-2 = 5 
Q3 = 1+3 + 5[Q0+Q + = 445-245] = - 


Application of the closed formula 
Qn = 2(n+1)H, —2n 
yields the small values 


Qi 
Qe 


| 
Hs 
be 

| 
DO 
| 
DO 


2-(14+ 1) — 2-1] 


2-(2+1)H2 — 2-2 


| 
m 


Qs = 2-(34+1)H3 = Ze HU64 


Section 2.8 Divide-&-Conquer Relations 53 





2.8 DIVIDE-&-CONQUER RELATIONS 


A divide-and-conquer strategy for solving a problem is 
to partition it into subproblems, such that the total effort 
needed to do all the subproblems is significantly less than 
a direct approach to the original problem. 


DEF: A recurrence of the form 
Lp = C&nsq + a(n) 
is said to be a divide-and-conquer recurrence. 


Remark: It represents that each of c subproblems is 
smaller than the original by a factor of d and in which 
a(n) is the cost of partitioning and recombining. 


Binary Search 


The signature step of a binary search is that the target 
key is compared to the key of the middle record. If it 
precedes the middle key, then the target record cannot 
be in the second half of the file, so it is inactive for the 
remainder of the search. Otherwise, the first half goes 
inactive. ‘This step is then applied recursively to the active 
half, until there is only one active record remaining. 


Example 2.8.1: Suppose we are searching for the target 
value y = 74 in the following list of length 16: 


1 18 31 34 35 39 42 47 


en ol 53 60 74 75 80 81 96 
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Initially, the entire list is active, with a lower limit location 
of lo = 1 and an upper limit location of hz = 16. 


In the first stage, the middle location is determined to be 
os a = 
5 = 


2 
The target value y = 74 is compared with the middle value 
Xo = 51. Since 








mid = | 


y=7T4 > #9 = 51 


and since the list is sorted, it follows that the target value 
y = TA, if present in the list, must be in the second half of 
the list, which becomes the only active sector. Resetting 
the lower limit to lo = 9 achieves the choice of active 
sector. 


In the second stage, the middle location of the active sector 


L9, .--, X16 18 location 


lo+thi _. Pato 
2 7 2 


= 13 








mid = | 


The target value y = 74 is compared with the middle value 
£13 = 75. Since 


y = 74 < L139 = fo 


it follows that the target value y = 74, if present in the 
list, must be in the first half of the active sector, which 
becomes the new active sector. Resetting the upper limit 
to ht = 12 accomplishes this. 
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In the third stage, the middle location of the active sector 
L9, .--, X12 18 location 


aad _ Ate] 








= ll 


mid = | 
2 2 


The target y = 74 is compared with x1; = 60. Since 
Y= 74 a L141 = 60 


it follows that the target y = 74, if present, must be in the 
2-4 half of the active sector, which becomes the current 
active sector. ‘Therefore, the lower limit is reset to lo = 11. 


In the fourth stage, the middle location of the active sector 
X11, X12 1s location 


= 12 





; eee] a 
mid = — | 


2 2 


The target y = 74 is compared with x12 = 74. Since 
Y= 74 2 12 > 74 


it follows that the target y = 74, if present in the list, must 
be in the 2"¢ half of the active sector, which becomes the 
final active sector, as the lower limit is reset to lo = 12. 


The final active sector has only one item. If it is not the 
target item, then the target item is not in the original list. 
If it is the target item, as in this example, then its location 
is returned as the output of the search. 
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The following algorithm gives the general rules for a binary 
search. 


Algorithm 2.8.1: Recursive Binary Search (RBS) 


Input: a non-decr seq X = (a;); range limits lo, ho; 
a target value y 

Output: if y € {21o,---, ni} then * (“not found”); 
else min{j € {lo,..., hi} | y= a; } 

call RBS(X, lo, hi, y) 

_. jlo ify = ie 

output := 4 ,. a. 


Recursive Subroutine RBS(X, lo, hi, y) 

if (o = hi then return 

else mid = |(hi + lo)/2| 

if y < fmiq then hi := mid — 1 else lo = mid 
call RBS(X, lo, hi, y) 





Analysis of the Time for a Binary Search 


Let 6, be the number of comparisons needed to per- 
form a binary search on an array of size n. Since at each 
stage, the limits of the active search space within the orig- 
inal sequence are reset to about half their previous range, 
the value of b, is represented by the following divide-and- 
conquer binary-search recurrence: 


by = 2: 
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The substitutions n = 2" and bo. = c, transform this to 


the recurrence 
Cp. = -2k 


Ch = Ch-1 +2 
The solution to the transformed recurrence is evidently 
Cc, = 2k+2 


from which it follows (by the inverse substitutions k = 
lgn and cign = bp) that the solution to the binary-search 
recurrence is 


b, = 2lgn+2 


Merging 
Mergesort is based on repeated merging. Algorithm 
2.8.2 prescribes a process for merging two sorted lists. 
Algorithm 2.8.2: Merge 


Input: non-decreasing lists Ly and Le 
Output: a merged non-decr list L, initially empty 


while both input lists are non-empty 


move min(head(L1), head(L2)) from its own list 
to the tail of the output list 

if that transfer makes one list empty then transfer 
all the remaining elements of the other list to 
the end of the output list 
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Example 2.8.2: Suppose that the input lists and output 
list are initially 


Ii: 2 14 30 37 55 
Io: 3 36 43° 65 
L: 


After two transfers, the lists are 


[Iy,: 14 30 37 55 
Ig: 36 438 65 
Ee 2 «3 


After two more transfers, the lists are 


[Iy: 37 55 
[y: 36 43 65 
L: 2 3 14 30 


The final lists are 


[y: 
Lo: 
L: 2 3 14 30 36 37 48 55 65 


The time needed to merge the lists L; and Lz is at 
worst proportional to the sum of their lengths. 
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Iterative Mergesort 


A mergesort is a sort by iterative merging of sublists 
of the initial list. 
Example 2.8.3: Suppose that the list to be sorted is 
X = [82 48 03 17 11 94 41° 37] 


which has length 8. From an iterative perspective, this 
list is initially viewed as a list of 8 files, each of length 1. 


X1 = [(82) (48) (03) (17) (11) (94) (41) (87)] 
The files of length 1 are paired, as follows: 


x — [((82) (48)) ((08) (17)) 
1 E((AL) (94)) ((41) (37) 


Merging the two sublists of length 1 within each pair yields 
this file with 4 sorted subfiles, each of length 2. 


Xe = [(48 82) (03 17) (11 94) (37 41)| 
The sorted subfiles are paired, as follows. 
Xs = [((48 82) (03 17)) ((11 94) (387 41))] 


Merging the two sublists of length 2 within each pair yields 
this file with 2 sorted subfiles, each of length 4. 


X3 = [(03 17 48 82) (11 37 41 94)] 
These two sorted subfiles of length 4 are paired. 
X, = (C038) 1% 248 82) “Cll Br 41 -94))] 


Then the two subfiles of length 4 are merged, thus ulti- 
mately yielding a fully sorted list of length 8. 


X = [03 11 17 37 41 48 82 94] 
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Recursive Mergesort 


In a recursive mergesort, the order of merger is a bit 
different from an iterative mergesort. E.g., the first two 
sorted sublists of length 2 are merged into a single sublist 
of length 4 before the rest of the sublists of length 1 are 
merged into sublists of length 2. Of course, the results are 
identical. Algorithm 2.8.3 is for recursive mergesort. 


Algorithm 2.8.3: Recursive Mergesort 


(nip: X S( Lis Bo ceces Bp) 
Output: that same sequence in non-decreasing order 


Recursive Subroutine MerSo(X) 


ifn >1 then 
m = [n/2] 
Rt SD iss oka ne) 
Xo = Dees U2, +04 Dis) 
X := Merge(Xj, X2) 





Analysis of the Time or a Mergesort 


Let s, be the number of comparisons needed in a 
mergesort on an array of size n. ‘The value of s,, is repre- 
sented by the following divide-and-conquer recurrence: 


Sy eS ly 


Syn = 28y/g +N 


The substitutions n = 2” and s 9x = t;, transform this into 


the recurrence 
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to = 1; 
bp = Dip see 


which we can solve with generating functions. 


OO OO OO 
Soe tk = De es +5 zkak 
k=1 k=1 k=1 





FO) <0 = ds) 4 — 
1 
= “Gea? 
= fp = (kA) 2" 


Thus, after the inverse substitutions k = lgn and tign = 
Sn, the solution to the mergesort recurrence is 


Sn = nign+n 


What enables the divide-and-conquer strategy of a 
mergesort to succeed at reducing the work effort, relative 
to naive forms of sorting, is that merging two sorted lists 
of equal length together takes less work than a naive sort 
of the union of the two lists. Naive sorts (e.g., insertion 
sorts and selection sorts) of n items require O(n”) steps. 
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The Josephus Recurrence 


During the Roman occupation of the Judean state, 
the Romans had trapped 41 Jewish rebels at a fortress 
called Jotapata. Rather than face likely slavery in Rome 
or public execution, these patriots made a suicide pact. 
Proceeding around a circle, every third man was to be 
killed, until there was only one remaining man, who would 
then kill himself. Joseph ben Mattiyahu ha-Cohen (who 
adopted the name Flavius Josephus after going over to 
the Romans), a survivor of several previous losses to the 
Romans, calculated what would be the last two positions 
on the circle whose occupants would remain alive, so that 
he and a friend could survive. 


DEF: The Josephus problem is to calculate a closed for- 
mula for the values of the sequence ae. the position of 
the last man alive, for a circle of n men in which every k*® 


man is killed. 


40 = ] 


19 = Flavius Josephus 


Fig 2.8.1 The Josephus problem Te 
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For the special case of 41 men, with every 2°¢ man 
killed (a variation from the historical event), we can read- 
ily simulate the entire process. In each cycle of this sim- 
ulation, the bold numbers are those of the men who are 
eliminated on that cycle. 


1 2 3 #4 ++. 39 40 41 O mod 2 
1 3 5 T +++ 387 39 Al 1 mod 4 
3. 7 11 15 --- 31 35 39 7 mod 8 
3 11 19 27 35 11 mod 16 
3 19 35 3 mod 32 


Thus, the man in position 19 is the survivor. 


The survivor position I for the first few values of 
n is given in Figure 2.8.2. Since every man in an even- 
numbered position is killed on the first cycle, every one of 
the survivor positions is an odd number. 


OO 


Nn 
JO) 


pe fe 
re 1N 
— | 
Qo | on 
| OS 
—]|—~ 
— 


Fig 2.8.2 Calculating I) for small values of n. 


After the first traversal of the elimination process 
around the circle, there are two possible cases, depend- 
ing on whether the number of men at the outset is odd or 
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even. If there are 2n men at the outset, then after elim- 
inating the even-numbered on the first cycle, the process 
location immediately precedes position 1. We may regard 
this as location 2n — 1, with a still-alive occupant, since 
the occupant of position 2n is gone, as shown in Figure 
2.8.3. The remaining n men, all odd-numbered, are shown 
just outside the circle. 


on-] an 1 ae 2n-1 1 


Fig 2.8.3 After one cycle, for an even configuration. 


This is equivalent to starting with n men, whose numbers 
are shown inside the circle. Each outer number is obtained 
by doubling the inner number and then subtracting 1. Of 
course, this applies to the survivor position. ‘Thus, we 
have the recursion 


I = 2s) 1 forn > 1 


If there are 2n-+ 1 men at the outset, then after elimi- 
nating the even-numbered on the first cycle, the next man 
to be killed is at position 1. The status of the process 
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immediately thereafter would be as illustrated in Figure 


2.8.4. Here, each outer number is obtained by doubling the 
inner number and adding 1, which yields the recursion 


Ts = 2J@) 41 for n > 1 


Thus, the recurrence problem to be solved is as follows: 


I? = 1 
To = 25) —1 for n > 1 
ds = 2J241 for n > 1 
on 2n+1 1 oe 2n+1 3 
2 5 
3 7 


Fig 2.8.4 After one cycle, for an odd configuration. 


Applying this divide-and-conquer recursion to n = 41 
yields a quick solution for that case: 
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I) = 258) 41 
= 2(2 2519 — + ads) —1 
105 21) a8 I = 
SOI y= 167. es 


16(25? —1) +3 = 327, -13 = 19 


Remark: When the Romans ultimately stormed into the 
fortress, all the Jews except for Josephus and his friend 
were dead. Upon hearing from Josephus how he and his 
friend had survived the suicide pact, the Romans recog- 
nized that Josephus was indeed a clever man, who could be 
quite valuable to them. Josephus lived out his life writing 
versions of history that flattered the Romans. 


To solve the more general problem of calculating I 
we extend the sample of small cases: 





From this increased set of small cases, a pattern emerges, 
as indicated by the following proposition. 
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Prop 2.8.1. lfn = 2” +k, with0O <k < 2’, then 
J = Ih+1 = 2(nmod aller} +1 


Proof: By induction on n. 
BASIS: ‘The equation is clearly true for n = 1. 


IND HYP: Assume the equation is true for all cases less 
than n. 


IND STEP: If n = 2’ +k is even, then k is even. Thus, 


J2) = Sy ha —1 (recursion) 
k 
— (2 cs + 1) —1 (induction hypothesis) 
= 2k+1 
If n = 2" +k is odd, then & — 1 is even, and 
J?) = 2 ates +1 (recursion) 


k—-1 
2 (2 =a + 1) +1 (induction hypothesis) 


Qk+1 > 


